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Abstract 

Cluster algorithms are developed for simulating quantum spin systems like 
the one- and two-dimensional Heisenberg ferro- and anti-ferromagnets. The 
corresponding two- and three-dimensional classical spin models with four-spin 
couplings are maped to blockspin models with two-blockspin interactions. 
Clusters of blockspins are updated collectively. The efficiency of the method 
is investigated in detail for one-dimensional spin chains. Then in most cases 
the new algorithms solve the problems of slowing down from which standard 
algorithms are suffering. 



Two-dimensional quantum spin systems are relevant for the description of the un- 
doped anti-ferromagnetic precursor insulators of high-Tc superconductors. Presum- 
ably understanding the physics of the superconductors requires an understanding of 
their precursor insulators. This already is a nontrivial problem, which most likely 
does not allow for a complete analytic solution. Therefore it is natural to use a nu- 
merical approach to compute the properties of these materials. At present different 
methods are used in numerical studies of quantum spin systems (for a recent review 
see for example ref.|l|). Small systems can be solved completely by a direct diag- 
onalization of the hamiltonian. For larger systems one can use Monte-Carlo meth- 
ods. For this purpose the finite temperature partition function of the (i-dimensional 
quantum spin system is expressed as a pathintegral of a (d-l- l)-dimensional classical 
system of Ising-like spin variables with four-spin couplings. The classical system is 
then simulated on a euclidean time lattice with lattice spacing e using importance 
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sampling techniques like the Metropolis algorithm. This approach was pioneered 
by Suzuki and collaborators 0]. An application to one-dimensional spin chains 
is described in ref. P]. For a simulation of the two-dimensional Heisenberg anti- 
ferromagnet see for example ref. [^]. The standard numerical methods are, however, 
slowed down in different ways. First of all most local changes of a configuration 
are forbidden, because many configurations have zero Boltzmann weight. Secondly, 
a change of the magnetization requires a nonlocal update, which has a very small 
acceptance rate at low temperatures. Finally, local algorithms are critically slowed 
down in the continuum limit e — > 0, because then any correlation length in euclidean 
time diverges in units of e. The slowing down of an algorithm is characterized by 
its dynamical critical exponent z. The exponent describes how the Monte-Carlo 
autocorrelation time r oc (i.e. the time needed to create a new statistically 
independent spin configuration) behaves in the continuum limit. 

For classical spin systems with two-spin couplings — like the Ising model — 
critical slowing down is almost entirely eliminated by the Swendsen-Wang and 
Wolff 1^ cluster algorithms for which 2; ^ 0. Cluster algorithms are, however, 
not directly applicable to models with four-spin couplings. In this paper we map 
the classical spin models with four-spin couplings to blockspin models with two- 
blockspin interactions, which are then simulated using the Swendsen-Wang or Wolff 
cluster algorithms. The blockspin cluster algorithm automatically creates allowed 
spin configurations only. Furthermore, it updates the magnetization efficiently even 
at low temperatures. The efficiency of the blockspin cluster algorithm is investigated 
in detail for the one-dimensional spin chains. We study the critical slowing down by 
investigating the e-dependence of the autocorrelation times of different observables. 
For example, the dynamical exponent of critical slowing down of the algorithm for 
the one-dimensional Heisenberg anti-ferromagnet is 2; = 0.0(1). The use of improved 
estimators substantially reduces the variance of measured observables. We should 
mention that it is presently not clear how efficient the algorithm works for two- 
dimensional spin systems. 

We consider quantum systems of spins 1/2 with a Hamilton operator 

H = Sx ■ Sx+p,, (1) 

X,fJ, 

where Sx = a^/S is a spin operator located at the point a; of a one-dimensional or two- 
dimensional quadratic lattice of even length L with periodic boundary conditions 
and are the Pauli matrices. The coupling is between nearest neighbors {fi is the 
unit vector in /^-direction) and J is the exchange coupling. For J < parallel spins 
are energetically favored and we have a ferromagnet, while J > corresponds to an 
anti-ferromagnet . 

To express the partition function as a pathintegral the hamiltonian of the one- 
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dimensional spin chain is decomposed into H = Hi + H2 with 



Hi^ J Sx- S^^i, J X ^x+i- (2) 

x=2m x=2m+l 

Now one uses the Trotter formula for the partition function 

Z = Tr exp{-pH) = limAr^ooTr[exp(-e/3//i) exp{-e(3H2)]^ , (3) 

where e = is the lattice spacing in the euclidean time direction and (3 is the 
inverse temperature. The original model is recovered in the continuum limit e — > 0. 
For the two-dimensional system one decomposes H — Hi + H2 + + H4 with 

Hi^ J X ^x+i^ H2^ J X ^x+h 

x={2m,n) x=(2m,+l,n) 

H3 = J ^x+2^ H4^ = J Y ^x- S^_^_2, (4) 

x=(m,2n) x={m,2n+l) 

and one uses the Suzuki formula 

Z = limjv->ooTr[exp(-e/3//i) exp(-e/3//2) exp(-e/3//3) exp(-e/3//4)]^. (5) 

In the next step the partition function is expressed as a pathintegral of Ising-like 
variables by inserting complete sets of eigenstates |1) and of between the 
factors exp(— e/?i7i). This gives rise to a (d + l)-dimensional classical spin system 
with periodic boundary conditions in the euclidean time direction. The Hi are sums 
of commuting terms. The nonzero elements of the transfer matrix are given by 

(1 1| eM-^PJSx ■ ^x+a)|1 1) = (-1 -1| eM-^PJSx ■ S,+f,)\-l -1) = 
exp(-e/3J/4), 

(1 -1| exp(-e/3j4 • -1> = H 1| exp(-e/3J>S, • 1) = 

exp(-6/?J/4)i(l + exp(6/3J)), 

(1 -1| exp{-epJSx ■ Sx+p,)\-l 1) = (-1 1| ex.p{-epJSx ■ S^+p,)]! -1) = 
exp(-e/3J/4)i(l-exp(e/3J)). (6) 

All other elements are equal to zero. For a ferromagnct (J < 0) the expressions are 
positive and can hence be interpreted as Boltzmann factors 

(S1S2I exp{-epJS^ ■ S^+p.)\s3S4) = exp(-5'[si, S2, S3, sj) (7) 

of spin configurations s = ±1 with a classical euclidean action S. For an anti- 
ferromagnet, on the other hand, this is not possible because some transfer matrix 
elements are negative. Therefore in the anti-fcrromagnctic case one performs a 
unitary transformation of the original hamiltonian by rotating every second spin by 
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an angle vr. The nonzero elements of the transfer matrix are then positive for J > 0. 
Expressed as a pathintegral the partition function takes the form 



z=n E exp(-5) 

a;,* s{x,t)=±l 



with 



X 



X 



exp(— S") = Y\_ ex.p{—S[s{x,t),s{x + i,t),s{x,t + l),s{x + i,t+l)]) 

x=2m,t=2p 

X \Y exp(-S'[s(x, t), s(x + i, t), s(x, t + 1), s(x + i, t + 1)]) 

x=2m+l,t=2p+l 

(9) 

in the one-dimensional case and with 

exp(— S") = W exp(— S'[s(x, if:), s(x + i, t), s(x, t + 1), s(x + i, t + 1)]) 

a;=(2m,n),t=4p 

n exp(-^[s(x, t), s{x + i, t), t + 1), s(a; + i, t + 1)]) 

x=(2m+l,n),t=4p+l 

n exp(-5[s(x, t), s(a; + 2, t), t + 1), s(x + 2, t + 1)]) 

x={m,2n),t=ip+2 

X JJ exp(-S'[s(x,)f:),s(x + 2,t),s(x,t + l),s(x + 2,t+ 1)]) 

x=(m.,2n+l),t=4p+3 

(10) 

for the two-dimensional system. Note that the classical spins s{x,t) interact with 
each other via four-spin couplings. Most spin configurations are forbidden (their 
Boltzmann factor vanishes) because the corresponding elements of the transfer ma- 
trix are zero. This is a problem for standard local algorithms because most local 
changes of a configuration are not allowed. Therefore it is natural to attempt a 
collective nonlocal update of the spins. For spin models with two-spin couplings 
this can be done using the Swendsen-Wang or Wolff cluster algorithms, which 
flip whole clusters of spins simultaneously. The cluster algorithms can, however, not 
be applied directly to models with four-spin interactions. 

To make an application of cluster algorithms possible we map the classical spin 
models with four-spin couplings to blockspin models with two-blockspin couphngs. 
A blockspin is a collection of a few spins. For the one-dimensional spin chain we 
define blockspins consisting of four spins located at the corners of a plaquette 

6(2m, 2p) = {s{x, t), s{x + i, t), s{x, t + 1), s{x + i,t + 1)} (11) 

with X = 2m— 1 and t = 2p. Note that each spin belongs to exactly one blockspin and 
the blockspins live one a lattice with a doubled lattice spacing. The original action 
determines the action for the blockspins. For example, the four-spin interactions for 
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Figure 1: Three different bloclcing schemes. The bloclcspins b and b consist of four 
spins and Uve on lattices with a doubled lattice spacing. The crossed plaquettes 
carry the four-spin interaction which turns into a two-blockspin interaction. In the 
third scheme one blockspin bo consists of all spins with the same space coordinate 

Xq. 




X — 2m, t — 2p induce couplings between space-like nearest neighbor blockspins at 
(2m, 2p) and (2m + 2, 2p) 

S[b{2m, 2p), b{2m + 2, 2p)\ = S[s{x, t), s{x + 1, t), s{x, t + 1), s{x + i,t + 1)], (12) 

and the four-spin interactions for x = 2m + 1, t = 2p + 1 induce couplings between 
time-like nearest neighbor blockspins at (2m, 2p) and (2m, 2p + 2) 

S[b{2m, 2p), b{2m, 2p + 2)] = S[s{x, t), s{x + i,t), s{x, t + 1), s{x + i,t + 1)]. (13) 

The spins can also be arranged to blockspins in another way 

6(2m, 2p) = {s{x, t), s{x + i,t), s{x, t + 1), s{x + i,t + 1)} (14) 

where now x — 2m and t — 2p — 1. Then the four-spin interactions for x — 
2m, t — 2p induce two-blockspin couplings between time-like nearest neighbors and 

the interactions at a; = 2m + l,t = 2p + 1 induce couplings between space-like 
nearest neighbors. The two blocking schemes of spins into blockspins are illustrated 
in figs.la,b. To ensure ergodicity an updating algorithm for the blockspins must 
alternate between the two blocking schemes. 

For the two-dimensional system a blockspin consists of eight spins located at the 
corners of a cube 

6(2m, 2n, 2p) = {s{x, t), s{x +l,t), s{x + 2,t), s{x + i + 2, t), 

s{x, t + l),s{x + i,t + l),s{x + 2,t + l),s{x + i + 2,t + 1)} (15) 

with X — (2m — 1, 2n — 1) and t = 2p. Again the blockspin lattice has a doubled 
lattice spacing. Another blocking scheme is given by 

6(2m, 2n, 2p) = {s{x, t), s(x + i,t), s(x + 2,t),s{x + 1 + 2, t), 

s{x, t + l),s{x + i,t + l),s{x + 2,t + l),s{x + l + 2,t + 1)} (16) 



5 



where now x = (2m, 2n) and t = 2p — 1. Using the action of eq.(|TO|) it is straight- 
forward to show that both schemes induce two-blockspin interactions only. Again, 
to ensure ergodicity the algorithm should alternate between the two schemes. 

The cluster algorithms make use of a flip symmetry of the blockspin model. A 
blockspin b = {si, S2, s„} is flipped to —b = {— Si, —S2, — s„} simply by flipping 
all spins that belong to b. It is clear that the blockspin action is invariant against 
flipping all blockspins simply because the original action is invariant against flipping 
all spins. The cluster algorithm puts bonds between nearest neighbor blockspins b 
and b' with the probability 

p= 1 -min{l,exp(-5[-6,6'])/exp(-5[6,6'])}. (17) 

Two blockspins which are connected by a bond belong to the same cluster. The 
algorithm flips all blockspins in one cluster simultaneously. In the Swendsen-Wang 
multi-cluster method each cluster is flipped with the probability 1/2. In the Wolff 
single-cluster method one blockspin is randomly selected and the cluster to which it 
belongs is flipped with probability 1. Recently, it has been realized that the single- 
cluster algorithm can be vectorized |^. Using S[b, —b'] = S[—b, b'] and S[—b, —b'] = 
S[b, b'] one can show that both algorithms obey detailed balance. The blockspin 
cluster algorithm automatically generates allowed spin configurations only. If one 
attempts to flip b when exp{—S[—b,b']) = 0, i.e. when the new configuration is 
forbidden, the algorithm puts a bond with probability p = 1 — min{l, 0} = 1. Hence 
b and b' fall in the same cluster and must be flipped simultaneously. The cluster 
growth comes to an end only when the new configuration is allowed. When one 
uses the single-cluster method it is guaranteed that one generates a new different 
configuration in each step. 

As defined up to now the blockspin cluster algorithms are not ergodic because 
they change the magnetization M = 1/2 J2x ^{^^ to) and the staggered magnetization 
Ms = l/2J2x{~^Ys{x,to) by even numbers only. M and Ms are integers (rather 
than half-integers) because we work on a lattice with an even number of space points. 
Note that M is independent of to because the transfer matrix commutes with the 
total spin. To allow M and Mg to change by odd numbers also, we introduce extra 
blocking schemes with some block spins bo = {s{xo,t) for all t} consisting of all 
spins with the same space coordinates xq. The other blockspins are taken from the 
above schemes. A typical example is shown in fig.lc. Similarily, we include blocking 
schemes which allow the so-called winding number = l/2J2t^{xo7t) fo change 
by an odd integer. 

The Swendsen-Wang and Wolff cluster algorithms eliminate critical slowing down 
from the Ising model because it is not frustrated. For strongly frustrated models, 
for example for spin glasses, cluster algorithms do not work efficiently. Therefore 
the question arises if our blockspin models are frustrated or not. To answer this 
question for the spin chains one must investigate all allowed configurations of four 
nearest neighbor blockspins located at the corners of a square of the blockspin lattice. 
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Nearest neighbor pairs of blockspins interact via bonds (the four-spin interactions 
of the original classical spin model). Now the Boltzmann factor of a bond is com- 
pared to the value it has when one of the two blockspins at its ends is flipped. 
The blockspin configuration with the larger Boltzmann factor is the favored config- 
uration of this bond. If one can flip the four blockspins such that all four bonds 
between them are in their favored configuration the configuration is not frustrated. 
We have verified that the blockspin model for the one-dimensional anti-ferromagnet 
has indeed no frustrated configurations. For the one-dimensional ferromagnet, on 
the other hand, some configurations are frustrated. In a frustrated configuration 
one of the four bonds cannot be in its favored configuration. However, one can 
show that the Boltzmann factor of the disfavored bond is in all cases only a factor 
(l-|-exp(e/3J))/2 smaller than the favored Boltzmann factor. In the continuum limit 
e — ^ the factor goes to 1 and the frustration disappears. A priori it is not clear if a 
weak frustration can slow down the cluster algorithm in the ferromagnetic case. As 
we will see later, the blockspin cluster algorithm does in fact work perfectly only in 
the anti-ferromagnetic case. However, also for the ferromagnet the autocorrelation 
times of the cluster algorithm are much smaller than the ones of the Metropohs al- 
gorithm. For the two-dimensional spin systems both for the ferromagnet and for the 
anti-ferromagnet some blockspin configurations are frustrated. In addition, not all 
frustrations disappear in the continuum limit. Therefore, one should not expect that 
the blockspin cluster algorithm for two-dimensional quantum spin systems works as 
well as in the one-dimensional case. However, we expect that it still decorrelates 
faster than standard algorithms. 

Cluster algorithms offer the possibility to use improved estimators which reduce 
the variance of different observables. For example, for the single-cluster method the 
susceptibility can be expressed as 

X-^AM')-2dNp{^), (18) 

where is the spatial volume, 2dN is the number of points in the euclidean time 
direction, \C\ = J2{x,t)ec^ is the cluster size and Mc = ^/'2J2{x,to)&c ^i^j^o) is the 
cluster magnetization. It is interesting to note that also Mc is independent of to. As 
a consequence, clusters with nonzero magnetization must wrap around the lattice 
in the euclidean time direction. Small clusters which do not wrap around the lattice 
have Mc = 0. Let be the minimal spatial extent of a cluster closed in euclidean 
time, i.e. = m.mtQ{J2{x,to)£C The cluster magnetization is then limited by 
\Mc\ < Lc/2 and the cluster size is restricted by \C\ > 2dNLc such that 

(L'c) > ^. (19) 

The algorithm updates the susceptibility efficiently only if many clusters wrapping 
around the euclidean time direction fit into the lattice. This requires (L^) <^ L'^. 
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Hence we expect that the cluster algorithm works efficiently only if 



X « ^- (20) 

The ferromagnetic systems have degenerate ground states with total spin In 
the zero temperature limit the susceptibility is then given by x = f3{L'^ + 2)/12 and 
the algorithm does not work efficiently. In all other cases, for example at non-zero 
temperature or for anti-ferromagnets, x stays finite as the spatial volume goes to 
infinity and the algorithm should work. One can also define an improved estimator 
for the staggered susceptibility Xs = P{M'^)/L'^. Since the staggered magnetization 
is to-dependent also small clusters contribute to Xs- Finally, we introduce the internal 
energy density e = —1/L'^{d hiZ/d(3). 

Now let us turn to the numerical results. We have tested the blockspin cluster 
algorithm in detail for one-dimensional spin chains. To test the efficiency of the 
blockspin cluster algorithm we compare it to a Metropolis update of the blockspins. 
In fact, the blockspin Metropohs algorithm is similar to the standard algorithms 
commonly used. For both algorithms we measure the autocorrelations of the sus- 
ceptibility 

cast) ^ Xir)x{r + St) (21) 

as a function of the Monte- Carlo time difference 5r. From this we obtain the inte- 
grated autocorrelation time as 

oo oo 

exp(-l/r^) = Y: C^iSr)/ ^ C^(5r). (22) 

<5t=1 5t=0 

Note that = tq for C^{5t) oc exp(— 5t/to). In the same way we define the 
integrated autocorrelation times r^^ of the staggered susceptibility and Tg of the 
internal energy density. For the cluster algorithm we use the single-cluster method 
and we measure the autocorrelations based on the improved estimators. Our results 
are summarized in table 1. The quoted autocorrelation times are in units of Monte- 
Carlo sweeps. A sweep is defined such that it takes about the same CPU-time for 
the cluster and for the Metropolis algorithm. In all cases we have performed a 
random start followed by 5000 sweeps for thermalization and by 50000 sweeps for 
measurements. 

The Metropolis algorithm can change the magnetization only by fiipping a block- 
spin bo which consists of all spins with the same space coordinate xq. The fiip is 
allowed only if all spins of Bq are parallel. Surprisingly, the probability for this 
situation — and hence the acceptance rate of the global step — is finite in the 
continuum limit. Therefore the autocorrelation times and r^^ do not diverge in 
the continuum limit. However, they are at least an order of magnitude larger than 
the ones of the cluster algorithm. The autocorrelation time of the internal energy 
density, on the other hand, diverges as Tg oc l/e^*^. For the Metropolis algorithm 
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Table 1: Results for the one-dimensional Heisenberg spin chains. The blockspin 
single-cluster algorithm (C) is compared to the Metropohs algorithm (M). 
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our (3 = 1 data both for the ferro- and for the anti-ferromagnet yield a dynamical 
critical exponent Ze = 0.8(1) while the cluster algorithm has Ze = 0.0(1). Note that 
the exponent may depend on the observable considered, because it was extracted 
from the integrated autocorrelation time and not from the exponential decay of an 
autocorrelation function. 

Although the global step of the Metropolis algorithm is not critically slowed 
down (its acceptance rate is e-independent) it is very severely slowed down at low 
temperatures (large jS). This prevents the application of standard numerical meth- 
ods to quantum spin systems at low temperatures. Already at /? = 8 the Metropolis 
algorithm has = 3300(200) for the ferromagnet and = 200(20) for the anti- 
ferromagnet. The cluster algorithm, on the other hand, has autocorrelation times of 
at most a few sweeps and one can go to lower temperatures like (3 = IQ very easily. 
For the ferromagnet the inequality x j3L'^ puts a lower limit on the temperature 
when the spatial volume is fixed. Our low temperature data for the ferromagnet at 
/3 = 16 show some slowing down but the autocorrelation times are moderate. For 
the anti-ferromagnet, on the other hand, there is no indication of slowing down 
when the temperature is lowered or when the continuum limit is approached and 

% = ^Xs = Ze = 0.0(1). 

To summarize we have developed blockspin cluster algorithms for one- and two- 
dimensional quantum spin systems. Our results for spin chains show that the new 
algorithms eliminate slowing down for anti-ferromagnets. For ferromagnets slowing 
down is also practically eliminated as long as the temperature is not too small. One 
should, however, be careful in generalizing our findings to two-dimensional quan- 
tum spin systems. Since the corresponding blockspin models have some frustrated 
configurations, it is presently not clear how efficient the algorithm works in this 
case. A detailed analysis of the efficiency of the blockspin cluster algorithm for 
the two-dimensional Heisenberg anti-ferromagnet is in progress. We like to mention 
that blockspin cluster algorithms can also be applied to other models. First of all 
the algorithm also works for spin systems with anisotropic couplings or (with slight 
modifications) in an external magnetic field. Secondly, it can be applied to models of 
higher spins [S = 1, 3/2, ...) if it is combined with a method that changes the abso- 
lute value of the spin projection \S^\. The one-dimensional Heisenberg spin chain is 
equivalent to a six- vertex model which is a special eight- vertex model. General eight- 
vertex models with a spin fiip symmetry can also be treated with blockspin cluster 
algorithms. Finally, the algorithm may be useful for simulations of one-dimensional 
Fermi-systems like the ones described in ref. [Q. 

It is a pleasure to thank P. Hasenfratz who initiated our interest in quantum 
spin systems for his support. 
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